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Abstract. One of the main objectives of this paper is to unravel a new interesting phenomenon 
of the sub-Riemannian Bernstein problem with respect to its Euclidean ancestor, with the 
purpose of also indicating a possible line of attack toward its solution. We show that the global 
intrinsic graphs (II. 21 axe unstable critical points of the horizontal perimeter. As a consequence 
of this fact, the study of the stability acquires a central position in the problem itself. 



1. Introduction 

The development of geometric measure theory in sub-Riemannian spaces has received a strong 
impul se over th e past decade , see jPalj . [Pa2], [HDHj, |KR|, (ET], p2| . |E3j, jUro], |UN|, [Be] . 
[PS], jDGNlj, |ATO] . |AK2] , [HST]. jj], [F55T| . |MaT| . |FSS2j . |Ma2j . [HMS], |F^3| . [BBS] , 
|DQN4| , |DGN5| . [LRj . jLMj, |FBS3) . jMa3j, [HSU EH, |P2j, [HE], [HHj, j(jHMYj . [HH] . [HPT] . 
[HP2] . [RRj . |BC] . (SHU, [Se2], [MqI. In particular, the papers |UP], jCHMYj and jDHj contain 
a detailed study of the Bernstein problem in the first Heisenberg group H , and in more general 
CR manifolds of real dimension three. Despite the progress made in these latter papers, this 
problem presently still constitutes a basic open question. One of the main objectives of this 
paper is to unravel a new interesting phenomenon of the sub-Riemannian Bernstein problem 
with respect to its Euclidean ancestor, with the purpose of also indicating a possible line of 
attack toward its solution. 

To provide the reader with some perspective, we recall that in the Heisenberg group HP a 
basic discovery of Franchi, Serapioni and Serra Cassano is a structure theorem a la De Giorgi for 
sets of locally finite horizontal perimeter FS^ (see |FSS3j for an extension to Carnot groups 
of step r = 2). To prove the latter they show that the non- isotropic blow-up of such a set at a 
point of its reduced boundary produces a vertical hyperplane 

(1.1) P 1 = {(x,y,t) G HP |< a,x > + < b,y >= 7} , a 2 + b V , 

(when 7 = these sets are also the maximal subgroups of HP). Recalling that the characteristic 
locus of a hypersurface S C HP, denoted henceforth by £(<S), is the collection of all points 
g € S at which T g S = H g M n , where HM n denotes the horizontal bundle of HP, it is easy to 
recognize that S(P 7 ) = for any 7 € M.. Therefore, in analogy with the Euclidean situation, 
the cited blow-up result from |FSSlj suggests the natural conjecture that if S C HP is a C 2 
entire i^-minimal graph over some hyperplane, and if X(<S) = 0, then S = P 7 for some 7. 
Here, following a perhaps unfortunate tradition of the classical situation, //-minimal is intended 
in the sense that <S is of class C 2 , and the horizontal mean curvature, defined in (|2.13jl below, 
vanishes identically as a continuous function on S. However, for HP the situation is very different 
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than in Euclidean space. In fact, it was proved in |GPj that there exist non-planar entire H- 
minimal graphs with empty characteristic locus, thus violating the above plausible conjecture. 
For instance, the non-planar real analytic surfaces 

(1.2) S = {(x, y, t) e H 1 | x = y(at + /?), a > 0, f3 £ M} , 

are iT-minimal, and they have empty characteristic locus. Moreover, the surfaces (|1.2|) are 
global intrinsic X\ -graphs in the sense of Franchi, Serapioni and Serra Cassano, see we 
stress that intrinsic graphs have empty characteristic locus by definition) . This means that there 
exists a globally defined function cj) : — > M such that, in the coordinates (x,y,t), we can 
parameterize (|1.2|) as follows 

(1.3) (x, y, t) = (0, u, v) o (f>(u, v)ei = (0, u, v) o (0(u, v), 0, 0) = [cj){u, v), u, v - ^</>{u, v)j , 

where o indicates the non-Abelian group multiplication in H 1 , see (|2.1|l . In fact, imposing the 
defining equation x = y(at + 0) for S, with a > 0, we obtain the function 

2u(av + [3) 
2 + ar 

which describes <S as an entire Xi-graph. We also note that a vertical plane P 7 is a global 
Xi-graph if a ^ (or an X2-graph if 6 ^ 0), with 

'y — bu 

(1.5) <f>(u,v) = , if a^0. 

Examples such as p.2|l seem to cast a dim light on the Bernstein problem in H 1 . There 
is however a deeper aspect of the problem which has gone unnoticed so far. What could be 
happening in fact is that, due to the different nature of the relevant perimeter functional, global 
intrinsic graphs such as (|1.2|) are only stationary for the horizontal perimeter, but not stable. 
In this paper we examine this aspect in depth. More precisely, we recall that, thanks to the 
convexity of the area functional 



A(u) = / a/1 + \Du\ 2 dx , n C 

Jn 



in the classical theory of minimal surfaces any critical point of A is automatically stable, i.e., 
it is a local minimizer, see e.g. |CM| . By contrast, we show that the global intrinsic graphs 
(|1.2I) are unstable critical points of the horizontal perimeter Ph(S) defined in (J2.22|) below. As a 
consequence of this fact, the study of the stability acquires a central position in the problem itself, 
and our results suggest that, if properly understood from this new perspective, the Bernstein 
property is still true in H . Besides their intrinsic interest, we believe that the relevance of our 
results lies in the method of proof, which is quite general and flexible, and has the potential 
of being successfully applied to attack the sub-Riemannian Bernstein problem. In Geometric 
Measure Theory there exist in essence two (different, but equivalent) approaches to stability: the 
former is based on the so-called method of calibrations, the latter on second variation formulas. 
Our approach revolves around a general second variation formula established in DGN3j, and on 
the explicit construction of a continuum of directions along which the intrinsic perimeter strictly 
decreases. We need to introduce a basic definition. 

Definition 1.1. We say that a C 2 oriented H -minimal surface 5 C i 1 , with £(<S) = 0, is 
stationary if it has vanishing first variation of the H-perimeter, i.e., if 



= 

A=0 
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for any deformation S — > S x = S + XX, where X E Cq^HI 1 ), with X ^ 0. We say that a 
stationary S is stable if the second variation is nonnegative, i.e., 



> , 

A=0 



for any X E Cq^H 1 ), with X ^ 0. If there exists such an X for which V^j{S; X) < 0, then we 
say that S is unstable. 

It has been proved in |DGN3| that S is stationary if and only if S is //-minimal, see Theorem 
13. II below. In this paper we establish the following result. 

Theorem 1.2. For every a > and f3 E R, the H -minimal global intrinsic X\-graphs 

(1.6) S = {(x,y,t) EM 1 | x = y(at + p)} , 

are unstable. More precisely, there exist a £ C^°(S), a ^ ; and h E Cg°(<S), h ^ 0, suc/i £/ia£ 
with either X = aX\, or X = hv^, we have Vfj{S\ X) < 0. 

To explain the strategy behind Theorem 11.21 we mention that in Section [2 we collect some 
preliminary material which constitutes the geometric backbone of the paper. The novel part 
of the paper is contained in Section |21 An essential ingredient in the proof of Theorem 11.21 is 
the second variation formula, see Theorem 13.21 below. Combining the latter with some basic 
sub-Riemannian integration by parts formulas, see Lemmas 13.51 and 13.61 we reduce the study 
of the stability of (|1.2|) to checking the validity of some Hardy type inequalities on S, see 
Lemmas 13.71 and 13.91 Using the representation of S as a global graph, we then pull back such 
Hardy inequalities to ones onto the (y, t)— plane, see Lemma 13.121 Finally, in Lemma 13. 131 and 
Corollary 13 . 141 we explicitly construct the directions such that, deforming the surface (|1.2j) along 
them, the //-perimeter strictly decreases. This establishes the instability of ()1.2|) . 

We would like to close this introduction with some conjectures which are suggested by the 
present work. Consider a C 2 , //-minimal intrinsic Xi-graph S C H . Denoting by B^ the 
linearized Burger's operator, whose action on a function F = F(u,v) is given by B ( p(F) = 
F u + (j)F v , then it was proved in Theorem 1.2 in |X5V that, provided that cp £ Cq(M. 2 ), the 
//-perimeter of S is given by 

(1.7) Ph(S) = [ Jl + B^) 2 duAdv . 

Now, if we think of l)1.7|) as a functional Ph(<(>) acting on eft, one can easily recognize that, given 
C E C^°(M. 2 ), then the first variation of Ph($) with respect to the deformation S — » S x = S+ X X, 
with X = C^ii is given by 

(1.8) Vf X) d -^fl = f 2 (Cu + 4>Cv + CM du A dv . 

dX a=o J R2 yT + B<f>(<j)) 2 

In view of Theorem 11.21 it is natural to make the following conjecture: Suppose that (f), 
belonging to a suitable Sobolev space, is a local (or even a global) minimizer of (|1.7j) . and 
therefore in particular also a critical point, then after modification on a set of measure zero, <fi 
must be of the type (|1.5[) . 

If we assume a priori that <p G C 2 (M 2 ), then integrating by parts in ()1.8|) we obtain that 



(1.9) Vf(S;*) = - / CbJ-jM^Uu^, (eC, 



3C / 
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On the other hand, under the same regularity hypothesis on <j) one can recognize, see |GSj . 
that 

(i-io) b, ( 7 £M =) =-n, 

where 7i represents the //-mean curvature of S, defined in (|2.13j) below. Therefore, a C 2 global 
intrinsic graph S is a critical point of (|1.7jl if and only if <S is .ff-minimal. As a consequence 
of these considerations, in the C 2 framework the above conjecture could be reformulated by 
saying that: The only C 2 , stable, global intrinsic graphs in H 1 are the vertical planes. Finally, 
we would also like to return to the conjecture in the opening of this introduction and amend 
it as follows: In M 1 the vertical planes (jl.lj) are the only C 2 , stable, entire H-minimal graphs 
(over some plane). 
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the University of Trento in April 2005. He would like to thank them for their gracious hospitality. 
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2. Preliminary material 

In this section we introduce some relevant notation and definitions from DGN3 which will 
be used in the proof of Theorem 11.21 We consider the first Heisenberg group H 1 = (]R 3 , o) with 
group law 

(2.1) (x,y,t) o (x>,y f ,t>) = (x + x', y + y', t + t' + X -(xy' - x'y^j , 

and non-isotropic dilations 5\(x,y,t) = (Xx, Xy, X 2 t), see 0. Hereafter, we will use the letters 
g = (x, y, t), g' = [x! ', y', t'), etc., to indicate points in Br. Denoting with (L g )* the differential of 
the left-translation operator L g : H 1 — ► H 1 defined by L g (g') = go g\ and letting ei , i = 1, 2, 3, 
indicate the standard orthonormal basis of ]R 3 , one readily verifies that 



(2.2) 



X 1 (g) d = f (L g U ei ) = I - | | 
X 2 {g) = f (L g Ue 2 ) = | + f | 
[T(g) t/ (L 9 ),(e 3 ) = | . 



The three vector fields {Xi, X 2 , T} generate the Lie algebra f) 1 of all left-invariant vector fields 
on H 1 . They satisfy at every point of H 1 the non-trivial commutation relation 

(2.3) [Xi,X 2 ] = T , 

all other commutators being trivial. In view of (|2.3|) . the Heisenberg group constitutes the first 
(and perhaps most important) prototype of a class of graded nilpotent Lie groups nowadays 
known as Carnot groups, see [El, 0, [Hroj . [Pa2j . [Be] . We observe explicitly that, if we let 
V\ = M. 2 y x {0}t, and V 2 = {0}a;,j/ x ^t, then the Heisenberg algebra admits the decomposition 
f) 1 = V\ © V 2 . We assume hereafter that HI 1 be endowed with a left-invariant Riemannian metric 
with respect to which {X\, X 2 ,T} constitute an orthonormal basis. The inner product with 
respect to this metric will be denoted by < •, • >. This is the only inner product that will be 
used in this paper, therefore there will be no confusion with other inner products, such as for 
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instance the Euclidean one, in M 3 . The corresponding Levi-Civita connection on H 1 will be 
denoted by VjF. We will denote by HM 1 the subbundle of the tangent bundle TM 1 generated 
by the distribution {Xi, X 2 }. The horizontal Levi-Civita connection is given as follows. For any 
X G r(TH 1 ), Y G TiHU 1 ) we let 

2 

(2.4) V^Y = < ^xY,X, > Xi , 

i=i 

and one can easily verify that V^y is metric preserving and torsion free, in the sense that if we 
define the horizontal torsion of S as 

T H (X,Y) = Vfy - Vy x ~ [X,Y] H , 

where [X,Y] H = £ 2 =1 < [X,Y],X l > Xi, then T H (X,Y) = 0. Given a function / G C^M 1 ), 
its Riemannian gradient is given by 

V/ = X x f X l + X 2 f X 2 + TfT, 

whereas its horizontal gradient is given by the projection of V/ onto the subbundle Mr, hence 

v H f = < V/,Xi > X x + < Vf,X 2 >X 2 = X x f X x + X 2 f x 2 . 

Given an oriented C 2 surface S C H , we denote by N its (non-unit) Riemannian normal 
with respect to the orthonormal frame {Xi, X 2 ,T}, and by v = N /\N\ its Riemannian Gauss 
map. We consider the quantities 

(2.5) p=<N,X 1 >, q=<N,X 2 >, u = < N,T > , W = Vp 2 +q 2 . 

In this paper we adopt the classical non-parametric point of view, see for instance MM , 
according to which a C 2 surface 5 C H 1 is a subset of R 3 which locally coincides with the zero 
set of a real function. Thus, for every go G S there exists an open set Oci 1 and a function 
4> G C 2 (0) such that: (i) \V4>(g)\ + for every g G O; (ii) S n O = {g G O \ 4>(g) = 0}. We will 
always assume that S is oriented in such a way that for every g G S one has 

N{g) = Vcf>(g) = X 1( j ) (g)X 1 + X 2 4>(g)X 2 + T4>(g)T . 

We note explicitly that, in this situation, the functions p, q, uj defined in (|2.5|) . which are given 
by p = X\<t>, q = X 2 (p, to = T(p, are not only defined on <S, but for every go G S they belong 
to C l {0). This notion of C 2 surface obviously includes the entire intrinsic graphs considered in 
Theorem 11.21 In fact, in the case of the surfaces S in (jl.6|) . we have (see (|3.17|0 . 

p = Xi<p = 1 + -y , q = X 2 (f> = -at -p - -xy , u = T<f> = -ay , 

and thus in particular the field N = pX\ + qX 2 + ujT belongs to ^(O,!! 1 ), with O = H 1 . 

We emphasize here that the local defining function <p i n (i) an d (ii) above has a different 
meaning from the function <f> in the definition of intrinsic graph in the introduction. Given a 
surface 5c! 1 , on the set iS \ 2(5) we define the horizontal Gauss map by 

(2.6) u H = V X 1 + q X 2 , 
where we have let 

(2.7) p = £ , q = |p , so that \u H \ 2 = f + q 2 = 1 on . 

Given a point go G S \ S(5), the horizontal tangent space of S at go is defined by 

HT go (S) = {v G H m n l |< v,v H (g ) > = 0} . 
Let us notice that a basis for HT go (S) is given by the vector field 

(2.8) ujj = qX 1 - pX 2 . 
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Given a function u G C l (S) one clearly has S7 H,s u(go) G HT go (S). We next recall some basic 
definitions from |DGN3j . 

Definition 2.1. Let S Ci 1 be a C 2 surface, with E(«S) = 0, i/ien we define the horizontal 
connection on S as follows. For every 1,7 6 C 1 ^; HTS) we let 

V% S Y = VfF - < VfF,i/ H > , 

w/iere Z,F G C^M 1 ; iffl 1 ) are suc/i that X = X,Y = Y onS. 

Similarly to the Riemannian case, it is possible to prove that Vy' Y does not depend on 
the extensions X, Y. The tangential horizontal gradient of a function / G C 1 (S) is defined as 
follows 

(2.9) V H > s f = V H J - < V H J,u H > u H , 

where / denotes any extension of / to all of HI 1 . The definition of V H,S f is well-posed since 
V^' 5 / only depends on the values of / on S. Since \vh\ = 1 on <S \ £(<S), we clearly have 
< V H,s f, uh >= 0, and therefore 

(2.10) |V H ' 5 /| 2 = |V H /| 2 - <V H J,v H > 2 . 

All the above definitions are specializations to H 1 of analogous ones for general Carnot groups, 
see |D(tN3| . The next definition contains the essential geometric concept of horizontal second 
fundamental form. It is convenient to state it for HP 1 , rather than H . 

Definition 2.2. Let S C HP be a C 2 hypersurface with £(<S) = 0, then for every X,Y G 
C 1 (S; HTS) we define a tensor field of type (0,2) on S, as follows 

(2.11) II H > S {X,Y) = < V^Y,v H > v H , 

where X, Y have the same meaning as in Definition \2.1l We call LL H ' S (-, •) the horizontal second 
fundamental form of S. We also define A H,S : HTS — ► HTS by letting for every g G S and 
u, v G HT g S 

(2.12) < A H ' S u,v > = - < LL H ' s (u,v),u H > = - <V§Y,u H >, 

where X, Y G C 1 (S,HTS) are such that X g = u, Y g = v, and X,Y are as above. We call the 
linear map A H)S : HT g S — > HT g S the horizontal shape operator. If e±, ...,e2 n -i denotes a local 
orthonormal frame for HTS, then the matrix of the horizontal shape operator with respect to 
the basis e±, e2 n -i is given by the (2n — 1) x (2n — 1) matrix — [ < V^ej, vu > ] . j 2n _ 1 - 

If S has non-empty characteristic locus S(«S), then we consider S' = S \ T,(S) and define the 
H-mean curvature of S at a point go G S' as follows 

2n-l 

(2.13) H = - trace A H ' S = - <V^e j ,u H > . 

We recall that is was proved in [Bj, [Ma3] that H Q ~ X (S(S)) = 0, where H s denotes the s- 
dimensional Hausdorff measure associated with the horizontal or Carnot-Caratheodory distance 
of G, and Q indicates the homogeneous dimension of G. If go G ^](<5) we 

WGto) = lim W( 5 ) , 

provided that such limit exists, finite or infinite. We do not define the ff-mean curvature at 
those points go G £(<S) at which the limit does not exist. The following result is taken from 
[DON 3j . 
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Proposition 2.3. The H-mean curvature of S Ci 1 coincides with the function 

2 

(2.14) H = Vf' S < u H ,Xi > = Vf" S p + V%' S q = X x p + X 2 q , 

i=l 

where p, q are as in (|2,7I) . 

Definition 2.4. A C 2 surface 5ctf is called H -minimal if7i = 0asa continuous function 
on S. 

In keeping up with the notation of DG JN3j it will be convenient to indicate with YQ and ZC, 
the respective actions of the vector fields uh and vjj on a function £ £ Cq(<S \ thus 

(2.15) yC = V XiC + q X 2 ( , Z( = f qX 1 ( - p X 2 ( . 

The frame {Z,Y,T} is orthonormal. It is worth observing that, since the metric tensor {gij} 
with respect to the inner product < •, • > has the property det{gij} = 1, then the (Riemannian) 
divergence in H 1 of these vector fields is given by 

(2.16) div Y = X x p + X 2 q = H , div Z = X x q - X 2 p . 
Using Cramer's rule one easily obtains from (|2.15|) 

(2.17) XiC, = q Z( + pY( , X 2 ( = q Y( - p ZQ . 
One also has 

(2.18) Vf ' 5 C = q Z(, Vf ' S C = -PZ(, 
so that 

(2.19) \V H ' S C\ 2 = (Z() 2 . 
We notice that 

(2.20) qZp - pZq = H . 

This can be easily recognized using Proposition 12.31 and (|2.17|) , as follows 

H = X\p + X 2 q = qZp — pZq + pYp + qYq = qZp — pZq , 

where we have used the fact that = ^Y(p 2 + q 2 )= pYp + qYq. Finally, we will need the 
following identity 

(2.21) H 2 = (Zp) 2 + (Zq) 2 . 

This can be easily proved observing that (|2.20|) and the identity p 2 + q 2 = 1 give 

U 2 = (Zp) 2 + (Zq 2 )-(pZp + qZq) = (Zp) 2 + (Zq 2 ) . 

In the classical theory of minimal surfaces, the concept of area or perimeter occupies a central 
position, see |DGlj . |DG2j . |DCPj . [G*] . [MM . In sub- Riemannian geometry there exists an ap- 
propriate notion of perimeter. Given an open set f2 C H 1 we denote J 7 (ft) = {C € C*o(^; HM 1 ) | 
I ICI — !}• ^ function u G L 1 ^) is said to belong to BVh(Q) (the space of functions with 

finite horizontal bounded variation), if 

Varn(u;Q) = sup / u divnC dg < oo . 
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This space becomes a Banach space with the norm ||w||Bvk(fi) = IMU 1 ^) + VarH(u;tl). 
Given a measurable set Bel 1 , the H-perimeter of E with respect to the open set f2 C H 1 is 
defined as follows, see for instance |CDG| . and |GN| . 

P h (E;Q) = Var H ( XE ;n) . 

Given an oriented C 2 surface S, we will denote by dan the //-perimeter measure concentrated 
on S. For any Borel subset Ec5 such that Ph{E) < oo, one has 

(2.22) P H (E) = [ do H = [ V< v,*\ > 2 + < v,X 2 > 2 da 

JE J E 

V< N,Xi > 2 + < N,X 2 > 2 /■ W , 

da = —— da , 



|-zv| 7ij |jvi 

where in the last equality we have used (|2.5|) . We thus obtain from (|2.22|) 
(2.23) d<7 H = — At , 

where dcr denotes the standard surface measure. 



3. Proof of Theorem 



This section is devoted to proving Theorem 11.21 In the course of the proof we need to build 
some auxiliary results which we fell have an independent interest. We begin by recalling the 
notions of first and second variation of the i?-perimeter introduced in Definition 11.11 Classical 
minimal surfaces are critical points of the perimeter (area functional). It is natural to ask what 
is the connection between the notion of //-minimal surface and that of //-perimeter. The answer 
to this question is contained in the following result from DGN]i|, see also |DGN2j . 



Theorem 3.1. Let 5ci' be an oriented C 2 surface with £(<S) = 0, then 

(3.1) Vf(«;«) = f H C °f ZN ^ 1*1 *>n ■ 

J s cos{u H ZN) 

where Z denotes the angle between vectors in the inner product <•,•>. In particular, S is 
stationary if and only if it is H -minimal. 



We emphasize that, thanks to the assumption S(5) = 0, the denominator in the integrand 
in the right-hand side of ()3.1|) does not vanish on S. We mention that versions of Theorem 
13.11 have also been obtained independently by other people. An approach based on motion by 
//-mean curvature can be found in |BCj . When X = hujj, then a proof based on CR-geometry 
can be found in jCHMYj . 

A central (and more complex) result for this paper is the following theorem established in 
DGN3_. Recalling the function co defined in (|2.5|) . henceforth we let tJ = uj/W. 



Theorem 3.2. Let S C H 1 be a C 2 oriented surface with E(S) = 0. The second variation of 
the H-perimeter with respect to the deformation S — > S x = S + XX , with X = aX\ + bX 2 + kT £ 
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Cq^H 1 ), is given by the formula 

(3.2) Vn{S;X) = f { - 2 (pZb -qZa) (Tk -WYk) 

2qZk — q(ap + bq) — p(aq — bp) 



+ (Ta-ZJYa) 



+ (Tb — uJYb) 



2pZk + p(ap + bq) — q(aq 



+ 2 (aq — bp)(qZa — pZb) u 

+ (Za + uJpZk) 2 + (Zb + uJqZk) 2 

+ (a 2 + b 2 )Zo 2 

+ 2 Zo(aZa + bZb) + 2 W 2 (ap + bq)Zk 
— (qZa — pZb + (aq — bp)uJ) 2 > dan- 



Corollary 3.3. If we choose a G Cg°(5) ; b = k = 0, and therefore X = aX\, then the 
corresponding second variation of the H -perimeter is given by 



(3.3) 



Vfj(S;X) = f s ^ 2 (Za) 2 +p 2 ^ 2 a 2 

+ u5Z(a 2 ) -p q(T(a 2 ) -uJY(a 2 )) \ da H ■ 
Proof. It follows in an elementary fashion from (|3.2|) . One only needs to keep in mind that 

□ 



p 2 + q 2 = 1 



Corollary 3.4. Given a C 3 oriented surface S C H , wii/i S(5) = ; consider the deformation 

(3.4) 5 A = S + A (/t u H + A; T) , h,k G C£(S) , 

corresponding to the choice X = phX\ + (7/1X2 (notice that a = ph, b = qh G Cg (<S) J. One /icts 



(3.5) 



LoZk^j 

+ 2 J hH (Tk- uJYk) da H 

+ J |lJZ(/i 2 ) + 2iliZfc + Ah 2 ^ da H , 



where we have set 

(3.6) A = (pTq — qTp) + Zj(qYp — pYq) + 0J 2 . 

Proof. We notice that we presently have 

pa + qb = h , qa — pb = , 

a Za + b Zb = h Zh , 
pZb — qZa = h(pZq — qZp) = — h 7i , 
where in the last equality we have used the identity (|2.20|) . We also have 
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Ta-UYa = p(Th-UYh) + h (Tp-ZJYp) , 
Tb-uJYb = q(Th-ZJYh) + h (Tq-ZJYq) , 

(Za + uJpZk) 2 = p 2 (Zh + uJZk) 2 

+ (Zp) 2 h 2 + IpZph (Zh + ZuZk) , 

{Zb + ujqZkf = q 2 (Zh + ujZkf 

+ (Zq) 2 h 2 + IqZqh (Zh + uZk) . 

We next observe that 

Substituting these formulas in the right-hand side of (|3.'2|) . and using (|2.21|) . we reach the 
desired conclusion. 

□ 

A different approach to a version of (|3.5|) based on CR-geometry was found in CHMY. To 
reduce further the expressions in the right-hand side of (|3.3|) , (j3.5|) we would like to transform the 
terms containing the derivatives Z(a 2 ), T(a 2 ), Y(a 2 ), Z(h 2 ). For this, we will use the following 
basic integration by parts formulas proved in [DGN3 . 

Lemma 3.5. Let S Cl 1 be a C 2 oriented surface with £(<S) = 0. For any ( E Cq(S) one has 

ZQ dan = — ( u dan ■ 
s Js 

Lemma 3.6. With S as in Lemma \S. ,51 for any function £ € Cq(S) one has 



T( dan = / Y( u dan + / C w W dan ■ 
s Js Js 



Using Lemma 13.51 we find 

(3.7) / ojZ(a 2 ) dan = \ Z (jDa 2 ) dan — / a 2 Zu3 dan 

= — a 2 uj 2 dan — \ a 2 Zuj dan ■ 
Js Js 

From Lemma 13.61 we obtain instead 

(3.8) - Jj>q{T{a 2 )-ujY{a 2 )) da H 

= J a 2 1 (pTq + qTp) — uJ(pYq + qYp) —pq cJ7i| dan ■ 
Substituting (|3.7|) . (|3.8j) into (|3.3|) . and keeping l|2.9j) in mind, we finally obtain. 

Lemma 3.7. Let 5ctf be a C 2 , oriented surface, with S(5) = 0, then the second variation 
of the H -perimeter, with respect to deformation S x = S + XaX\, is given by 



(3.9) 



VfjiSiaXi) = J p 2 \V H ' S a\ 2 da H + J a 2 {{pTq + qTp) -ZJ{pYq + qYp) 



uj — Zu) — p q LuTt > dan ■ 
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To establish the next lemma we need the following auxiliary result. 



n 



Lemma 3.8. On a surface S as in Lemma \S. T[ one has 

— Zu = A , 

where A is the quantity defined in (|3,6|) . 
Proof. From the definition of uJ one has 

(*m\ y- - ZW Zu 

(3.10) - 2, = u — - — 

We now claim that 

(3.11) = q Tp — p Tq , 



W 



and that, furthermore, 



ZW 

(3.12) — = qYp - pYq + uJ . 

It should be obvious to the reader that, inserting (|3.11j) . 1)3.12(1 into (|3.1U|) . we obtain the 
desired conclusion. We are thus left with proving (|3.11|) and (|3.12|) . For the former, we observe 
that 

< Z, N > = . 

If (ft denotes a local defining function of S in the neighborhood of an arbitrary point, we thus 
have Z(ft = 0. Applying T to this identity, we obtain 

= T{Z(ft) = T(qX 1( ft - pX 2 (ft) = TqX 1( ft + qTXtf - TpX 2 (ft - pTX 2 (ft 
= TqX lC ft-TpX 2 (ft + qX 1 T(ft-pX 2 T(ft = pTq - qTp + Z(Tcft) , 

where we have used [-Xj,T] = 0, i = 1, 2. It follows that 

Zuj Z(T(ft) 

which proves (|3,11|) , As for (|3.12|) . we have 

lj = T(ft = X X X 2 (\) - X 2 X 1( ft = Xx(qW) - X 2 {pW) = - (X 2 p - X{q) W + ZW , 
from which the desired conclusion follows immediately. 

□ 

Using Lemma 13.51 in (|3.5|) of Corollary 13.41 in combination with Lemma 13.81 we obtain. 

Lemma 3.9. Let 5 Ci 1 be a C 3 , oriented surface, with X(<S) = 0, then the second variation 
of the H -perimeter with respect to the deformation of S x = S + Xhuu, is given by 

uj 2 ) } da H 



(3.13) Vf^S-hvH) = f ^{Zh) 2 + h 2 (2A 

= J | {Zhf + h 2 [2(pTq - qTp) + 2uJ(qYp ~ pYq) + uJ 2 ] j da H 



where A is defined in (|3.6|) , 
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After these preparations we turn to the core of the proof of Theorem 11.21 We will focus on 
the case in which the surface is given by 

(3.14) S = {(x,y,t) ei 1 | sc = y(at + (3)} , 

the other family of surfaces S = {(x,y,t) £ M 1 \ y = x(at + /?)}, with a < and /3 E R, being 
treated by completely analogous considerations. Our first step in the proof of Theorem 11.21 is 
to compute the second variation of the ff-perimeter for S. In view of ()3.9j) in Lemma 13.71 or 
(|3.13|) in Lemma 13. 9| we need to compute the quantities which appear as the coefficient of a 2 
and h 2 in the integral in the right-hand side of the respective formulas. This is the content of 
the next lemma. 

Lemma 3.10. Let S be the H -minimal surface given by (|3.14|) . then one has 

(3.15) (pTq + qTp) — oJ(pYq + qYp) — q 2 oJ 2 

2a 



Zlo — p q uj TC 



W 2 (l + (at + I3) 2 ) ' 



(3.16) 2(pTq - qTp) + 2uo(qYp - pYq) +ZJ 2 = - . 

Proof. We can use the global defining function c/)(x,y,t) = x — y(at + (3). As previously 
stipulated, we assume that S is oriented in such a way that N = = X\(f> Xi+X2(j) X2+Tcj) T. 
Recalling (|2.5|) . simple calculations based on (|2.2|) thus give 

(3.17) p = Xi<j> = 1 + ^y 2 , q = X 2 <t> = -at - (3 - ^xy , u=T<f> = -ay. 
The second equation in (|3.17|) becomes on S 

(3.18) q = -{at + (3)(l + %j< 



We thus find on S 



(3.19) W 2 = |V^| 2 = (l + |y 2 j (l + (at + Pf 
Using 1)2. 15|) we obtain 

(3.20) Z(T<j>) = qXiW) - pX^) = ^ = - (l + f ^ > 0. 
Next, we have 

(3.21) X\p = , X%q = , X2P = ay , X2q = — ax . 
This gives 

(3.22) AW = = 0, X 2 W = 2^±^1 = ay^ + iat + p) 2 ))^ 
From (l2~T51) and (l3~2"2l we find 

..23) ZW = qX x 

Combining (|3.23|) with (|3.2U|) we obtain 

Z(T6) T6 a - <£y 2 

Using the above formulas it is not difficult to verify that 
(3.25) Yp = Yq = . 



2 



(3.23) ZW = qXiW -pX 2 W = - -^X 2 W = - ay 
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We now have from ()3.17f> 



_ pTp + qTq _ _ aq 
W W ' 



and therefore we easily find 



{ T75 a(at+ff) _ a(ai+jg) 

^ (l+fy2)(l+(at+/3)2)3/2 W(T+(^W) 

T7 l = ~ W{l+{at+f3Y) ■ 

From (|3.17j) and Q3.26J1 we conclude that 

a(l + fy 2 ) ((at + pf-l) 



(3 - 27) pTq + qTp- W 2 (1 + {at + m ' 

From (J3.18|) . (|3.24|) . and (|3.27j) . and elementary computations, we easily reach the conclusion 
that (|3~T5|) holds. In a similar fashion, we obtain the proof of (|3~TH|) by (|3~T7)) . (jXTHj) . (|3~T^|) 
and (HCUD - 

□ 

From Lemmas 13.71 13.91 and I3.1U1 we obtain the following corollary. 

Corollary 3.11. Let S be the H -minimal surface given by (|3.14j) . For any a G Cq*{S), the 
second variation along the deformation S — > <S A = 5 + AaXi is given by 

(3.28) HBW*) = jk+SfLv**^ - 2a J s W1[l+ a * ot + m <i°H ■ 

For any /i € Cq°(<S), t/ie second variation along the deformation S — > <S A = 5 + Xhi>n is given 
by 

(3.29) V#(<S; ^ff) = jf iV^^pd^ - 2 a J iL. d* H ■ 

We now consider the global smooth parametrization 6 : M? — > M 3 of the surface 5 given by 
0(y, t) = (y(at + 0),y,t). Clearly, 5 - »>™ 2 ' 



Lemma 3.12. Let S be the H -minimal surface given by (j3.14|) . For any a G Cq°(<S), i/ien one 
has 

(3.30) W*>^ = L wJ+wfa W 

v? 



2a L (l + f2/ 2 )(l + M + /3) 2 ) 3 / 2 ^ 
where u = a o 9 G Cq°(M. 2 ). For any h G Cq°(S), the one has 

u 2 



2 ° ' (l + f2/ 2) (1 + M + /3)2) i/2 d ^ 



where this time we have set u = h o G Cg°(K ) 
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Proof. In order to prove ()3.3U() we make some reductions. Keeping in mind that from (|2.23f) 
we have da H = (| V H 4>\/\V(j)\)da = (W/\V<j)\)da, from (1X19(1 we obtain 

j s W^l + {at + m ~ J R , (1 + «y2) (1 + ^ + ^)2)3/2 ^ l - 

In order to express the first integral in the right-hand side of Q3.28JI as an integral on IR 2 , we 
compute \V H ' S a\ 2 . We have from & (JTTSJ), (ETTTl) and (BUI) 

(3.32) \V H ' S a\ 2 = (Zaf = (qX ia -pX 2 a) 2 

((at + f3)X 1 a + X 2 a) 2 
1 + (at + 0)2 ' 

Now, the chain rule gives u,, = (at + (3)a x + a y , and therefore we see from ()2.2() that we have 
on <S 

(at + j3)X\a + X 2 a = (at + (3) a x + a y = u y . 
From 1)3.32)1 we thus conclude that 

p 2 too d** = / -±-—*l-Ly dydt . 



□ 



(1 + (at + /?) 2 ) 3 / 2 

This proves 1)3.30(1 . The proof of 1)3.31(1 proceeds analogously, and we omit the details. 



Lemma 3.13. Let Xk £ Cq°(R) be such that < Xk(s) < 1, Xk(s) = for \s\ > 2k, Xk(s) = 1 
/or |s| < k, and \x'k( s )\ ^ Cfk with C independent of k. Define for any a > 

f , s Xifc(y) 

PFe /iaue £ C^°(]R), and t/iere exists k$ G N smc/i t/iat /or a// k > k^ 

Proof. We begin by observing that integration of the right-hand side of ()3.33() gives 
(3-34) / (l + % 2 )f' k (y) 2 dy 

Observing that 



^— 2 dy 



,1 + fyV (l + fy 2 ) 2 ' 
we conclude from ()3.34() and dominated convergence 

(3,5) /(H^»f«^Q + i/ t 



a / 1 a 7r 

— / tt ay = a , as k — > oo . 

2j R (l + |y2)2 V 2 2 
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On the other hand, again by dominated convergence, we obtain for the integral in the left-hand 
side of (l3~33|l 

(3.36) / P^dy = [ Xk{y? „ dy 

vr [2 



tt dy = — \ — as k — > oo 

;i+§2/ 2 ) 2 2 v« 



In view of ()3.35|) , ()3.36|) , we obtain 



2'- 

From this the conclusion readily follows. 



-J- 

8 V a 



□ 



As an immediate consequence of Lemma 13. 131 and Fubini's theorem we obtain. 



Corollary 3.14. For k € N, k > ko, define Uk(y,t) = fk(y)Xk(t), where Xk and f k and ko are 
as in Lemma \3.13l One has 

,,, 7 ^ f u k{y,t) 2 1 f l + fy 2 ( du k (y,t) \ 2 

{ ' L (1 + f y 2 )(l + (at + m 3/2 ^ 2a J R , (1 + (at + /3) 2 ) 3 / 2 V dy ) ^ " 

We are finally ready to give the 

Proof of Theorem \1.2l Let Uk , k > ko , be as in Corollary l3~T4l Define a k : M 1 -> R, a k G 

C^°(EI 1 ), as follows 

/ ,x Xk(y)Xk(t)Xk(x -y(at + 13)) 
a k (x,y,t) = . 

v 1 + 2 y 

We observe that a k (0(y,t)) = u k (y,t)xk(0) = u k (y,t). At this point, appealing to H3.3U|) in 
Lemma 13.121 and to Corollary 13.141 we conclude that for every fixed k > ko , we have for the 
deformation S — > <S A = 5 + AafcXi 



2 



Vg(5;o fc Xi) = ^Ph(S x ) 



< 

A=0 



This proves that S cannot be a local minimizer of the H -perimeter for compactly supported 
deformations along X\ . In a similar way, using (|3.3Ujl in Lemma 13.121 and Corollary 13.141 we 
see that S cannot be a local minimizer for deformations along the horizontal normal v^. In 
particular, since every global minimizer is also a local one, S cannot be a global minimizer either. 

□ 
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